Clustering of exponentially separating trajectories 
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It might be expected that trajectories for a dynamical system which has no negative Lyapunov 
exponent (implying exponential growth of small separations) will not cluster together. However, 
clustering can occur such that the density p(Ax) of trajectories within distance Ax of a reference 
trajectory has a power-law divergence, so that p(Ax) ~ Ax~^ when Aa; is sufficiently small, for 
some < ft < 1. We demonstrate this effect using a random map in one dimension. We find no 
evidence for this effect in the chaotic logistic map, and argue that the effect is harder to observe in 
deterministic maps. 
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PACS numbers: 05.40.-a,05.45-a 

1. Introduction. It is well known that the trajecto- 
ries of simple dynamical systems can approach fractal 
sets known as strange attractors p], Q ■ These arise when 
the largest Lyapunov exponent is positive, implying that 
trajectories diverge exponentially, but where there is con- 
traction (characterised by negative Lyapunov exponents) 
in other directions, so that volume elements contract. 
Here we demonstrate an alternative mechanism for tra- 
jectories of a dynamical system to exhibit fractal clus- 
tering effects. We demonstrate, explain and analyse how 
fractal clustering of trajectories may occur in a system 
which has no negative Lyapunov exponents, so that there 
is no attractor. 

Fractal measures which arise in the study of dynami- 
cal systems are typically multifractal, in the sense that 
their Renyi dimensions D q (discussed in 0, Q) are not 
all equal. Exponential separation in all directions implies 
that the invariant density must cover a set of finite mea- 
sure, so that for systems with only positive Lyapunov 
exponents the box-counting dimension Do is equal to the 
space dimension, d. Furthermore, the Kaplan- Yorke for- 
mula 0] for the Lyapunov dimension Z?l gives Z?l = d if 
the sum of the Lyapunov exponents is positive. It is be- 
lieved that Dl = D\ [5], so that we conclude that D\ = d 
for the systems which we consider. There does not ap- 
pear to be any constraint which implies D2 = d when all 
of the Lyapunov exponents are positive. It is, however, 
hard to conceive of how fractal clustering can occur in a 
situation where trajectories are separating exponentially 
in each direction. If a cluster with arbitrarily high den- 
sity is to form, the trajectories which participate have to 
'beat the odds' by coming closer together throughout a 
long sequence of iterations of the map, despite the fact 
that positive Lyapunov exponents imply that separations 
are more likely to increase than to decrease. 

2. The Lyapunov exponent and correlation dimension. 
We will discuss the simplest case which illustrates our 
conclusion, which is that of chaotic maps in one dimen- 
sion. The extensions to flows and to higher dimensions 
are straightforward. We start by reviewing the defini- 
tions of the Lyapunov exponent A and of the correlation 
dimension Z?2- ft is possible to describe the fractal at- 



tractor of a deterministic map by considering a measure 
on the set of points visited by a single trajectory. In 
this paper, however, we shall consider random as well as 
deterministic maps, so that the fractal measures upon 
which trajectories might congregate are not fixed in the 
coordinate space. We will, therefore, describe clustering 
in terms of the behaviour of trajectories with different 
initial conditions, examined at the same 'time' (that is, 
iteration number). The initial distribution of the trajec- 
tories is a random scatter across the coordinate space, 
with uniform density. 

The infinitesimal separation Sx of two trajectories is 
characterised by the Lyapunov exponent, A [2j. For 
a one-dimensional map generating a sequence of points 
x\, X2, ■ ■ ■ , Xi, . . . this is defined by writing 
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where the Sxi are infinitesimal separations of two tra- 
jectories at the ith iteration (throughout this paper (X) 
will denote the expectation value of X). If A < 0, the 
separation of two very close orbits will approach zero 
with a probability which approaches unity as the initial 
separation approaches zero. If A > 0, the separation of 
two orbits which are initially very close increases with a 
probability which approaches one as the initial separation 
decreases. Given this observation, it would be surprising 
to see trajectories clustering together if A > 0. Here we 
will show that clustering may occur, such that the proba- 
bility density p for the separation of trajectories, Aa; has 
a power-law dependence for small values of Ax, i.e. 



p(Ax) ~ Aa 
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with < < 1. 

The Renyi dimensions D q are defined by dividing the 
configuration space into cells, labelled by an index i, with 
size e, which are occupied with probability pf. 
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The dimension D2 is known as the correlation dimension 
and is related to the exponent {3 in ©. It follows from 
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Q that the number J\f of trajectories in a ball of ra- 
dius e about a randomly selected test trajectory satisfies 
(A/"(e)) ~ e D2 @- The probability density for trajectory 
separations in one dimension is p(e) — d{M) /de, so that 
£>2 = l-/9. 

3. Analysis of clustering. We consider the dynamics of 
a one-dimensional map, of the form 

= fn(x n ) (4) 

where the functions /„ (x) may be independent of n (that 
is, the map may be deterministic), or they are selected at 
random from an ensemble at each iteration. We concen- 
trate upon chaotic maps, where the Lyapunov exponent 
is positive. We will assume that the iterations do not 
escape from some finite region, so that there is an upper 
bound on the separation of two trajectories. We allow 
for the possibility of a random map because the analysis 
can be taken further in that case and because random 
maps play a role in modelling many different physical 
processes. 

Both the Lyapunov exponent A and the clustering ex- 
ponent /3 characterise small separations of trajectories, 
Ax. As Ax — > these become infinitesimal separations, 
denoted by Sx. The evolution of the infinitesimal sepa- 
rations is described by the linearised equation of motion, 
<5x„+i = f' n {x n )8x n . It is convenient to consider the 
variable Y n = lnAx„, which we express in terms of its 
incremental changes at each iteration, Z n : 

n-l 

Y n = ln(Ax„) = ln(Ax ) +J]Z< (5) 

i=Q 

where, in the limit where Axi is sufficiently small, we 
have 

Z n = ln|/;(x„)| . (6) 

Even for a deterministic map, the quantity Z n differs 
from one iteration to the next, and if the map is chaotic 
this variation will appear to be random. 

We now consider how both the Lyapunov exponent A 
and the clustering exponent /3 are related to the statistics 
of Z. It is clear from the definitions (TTJ) and ([5]) that 

A = (Z(t)) . (7) 

Let us consider dynamics of Y n . Because the displace- 
ments Z n can be considered as random variables, the 
quantity Y n executes a random walk with drift when Ax„ 
is sufficiently small. The variable Y has diffusive fluctu- 
ations, with the variance of AY n = Yi +n — Yi increasing 
linearly as a function of the 'time', n: 

lim ((AY n -nA)3) =2p 

n— >oo fi 

The diffusion coefficient V is determined from the corre- 
lation function of the fluctuations 

oo 

V = \Y. [{Z n Z,)-{Zf] . (9) 



We characterise the behaviour of Y n in terms of its prob- 
ability density, p n (Y). If the probability density p n (Y) 
varies sufficiently slowly as a a function of Y, we may 
approximate its evolution by discrete-time version of the 
Fokker-Planck equation [6] : 

d d 2 

Pn+l - Pn = -gy(vPn) + gy^i^Pn) (10) 

where the drift velocity v = (Z) is, by (|7J|, equal to the 
Lyapunov exponent. The steady-state solution of equa- 
tion (|10p . p Sl is an exponential function: 

p s (Y) = Acxp(ar) (11) 

where a — v/T>. This solution is not normalisable and 
we should therefore consider the conditions under which 
it is applicable. The linearised mapping ceases to be ap- 
plicable when Ax is too large. Because the growth of Ax 
is assumed to be bounded, the probability density p s (Y) 
should have a normalisable steady state. We can there- 
fore meaningfully consider a solution of the form (jlip 
with positive values of a, because the solution is matched 
to another function at some cutoff value. However there 
is no lower cutoff, so that solutions with negative values 
of a are untenable. 

Now consider the implications of (TTTj) for the probabil- 
ity density of trajectory separations. Transforming (|11[) 
to a density p(Ax) by writing dP = Aexp(aY)dY = 
p(Ax)dAx, we find p(Ax) = AAx Q_1 . We conclude that 
clustering should occur when a < 1, and that the corre- 
lation dimension is the same as the exponent in (|11[) : we 
have 

D 2 = a = l-f3. (12) 

The use of the Fokker-Planck equation is only justi- 
fied when the gradient of p n (Y) is sufficiently small. The 
condition is that dp n /dY should be small compared to 
1/5Yq, where 5Yo is the scale over which Y varies dur- 
ing its correlation time. This condition for the valid- 
ity of ([TT|) is equivalent to D2 -C 1. We remark that 
Grassberger and Procaccia 0] also used a Fokker-Planck 
equation for the logarithm of trajectory separations in 
a discussion of the correlation dimension. They consid- 
ered a strange attractor, rather than a system with only 
positive Lyapunov exponents. 

From these considerations we make the following con- 
clusions. For any chaotic map, we can calculate the mean 
value and variance of Z n = ln|/^(x n )|. The mean value 
is equal to the Lyapunov exponent, A = (Z), and for a 
chaotic map this is a positive number. The fluctuations 
of Y = InAx execute a random walk, with diffusion co- 
efficient V. When the probability density of Y varies 
sufficiently slowly, this obeys a Fokker-Planck equation. 
The stationary solution of this equation is an exponen- 
tial which in turn implies that the distribution of Ax is 
a power-law. The assumption that the probability den- 
sity is slowly varying is justified when D2 = a <C 1, a 
limit in which there is strong clustering. In this limit we 
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have seen that the correlation dimension is given by the 
asymptotic expression 



Da = A/2? 



(13) 



Thus clustering is expected to occur for a chaotic one- 
dimensional map upon varying a parameter so that the 
Lyapunov exponent approaches zero (from above). The 
only way to avoid this conclusion is if the diffusion con- 
stant T> approaches zero at the same time as the Lya- 
punov exponent A. 

4. Correlated random walk model. We shall now illus- 
trate the clustering phenomenon using a simple random 
dynamical system, namely a random walk for which the 
random displacement is a smoothly varying function of 
the current position. The map is 



(14) 



and the function g n (x) is a realisation of a random pro- 
cess with statistics specified by a function C(x — x'): 

(g n (x)) = , (g n {x)g m (x')) = 5 nm C(x - x') . (15) 

Furthermore we consider the coordinate x to be cyclic, 
so that the positions x and x + L are equivalent. (This 
implies that the functions g n (x) are periodic with period 
L). This model has been discussed in earlier work [8] 
where it was pointed out that the Lyapunov exponent is 
negative when the functions g n (x) are sufficiently small. 
The model is of some physical interest as a model for 
the motion of particles advected by a spatially smooth 
velocity field, such as a fluid flow Q. Its attraction in 
the present context is that it allows us to write down 
and analyse an exact (although implicit) equation for the 
correlation dimension, D 2 = a. 

Because there is no correlation between the random 
displacements at successive iterations, the probability 
density p n +i for Y n+ i may be expressed exactly in terms 
of density p n of Y n . For sufficiently small Ax we have: 



p n +x{Y) = / dZ P(Z) Pn (Y-Z) 



(16) 



where P(Z) is the probability density of Z n = |l+.g'(a; n )|. 
This equation has a steady-state solution of the form 
(fTTj) . that is p s (Y) = Aexp(aY) for some constant A 
and for an appropriate choice of a. By substituting (|11[) 
into ([TBI), we find that a satisfies 



dZ exp(-aZ)P(Z) = 1 . (17) 



(exp(— aZ)) 



It is a simple exercise to reproduce equation (|13l) from 
this equation by writing (exp(— aZ)) = 1 — a(Z) + 
\a 2 [{Z 2 ) - (Z) 2 } + 0(a 3 ). If equation $T7$ has a solu- 
tion with < a < 1, this demonstrates conclusively that 
fractal clustering exists for a model with only positive 
Lyapunov exponents. 

We made a numerical investigation of the model de- 
scribed by (TUT) and (fT5|) . in the case where the noise has 
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FIG. 1: Illustrating clustering of the trajectories of the corre- 
lated random walk model defined by equations (|14[l and (|15|) . 



a Gaussian distribution and where the correlation func- 
tion is C(x) — <7 2 £ 2 exp(— £ 2 /2£ 2 ) (for some constants 
<7 and £). The density of trajectories in this model is 
illustrated in figure [TJ where we show a scatter plot of 
the positions for a realisation of the dynamics described 
by (fl"4"|) and (IT51) as a function of iteration number, for 
a case where the Lyapunov exponent is positive. This 
shows that the trajectories cluster together, rather than 
becoming uniformly distributed, as might be expected. 
The probability density p(Ax) for a trajectory to occur 
at a distance Ax from a randomly chosen test trajec- 
tory was found to have a power-law form, as described 
by equation ([2]), implying that the distribution can be 
regarded as a fractal set, with correlation dimension D 2 . 

As well as confirming that clustering occurs, it is inter- 
esting to consider the quantitative predictions from f| 1 T[) 
in the case where the random functions g n (x) have Gaus- 
sian statistics. Specifically, we assume that the quantities 
G n = g'(x n ) are Gaussian distributed, with variance a 2 
(the mean value is obviously zero). In this case the rela- 
tion (fl~7|) becomes 

/oo 
dG 8{Z - ln|l + G\)P{G) exp(-aZ) 
-00 

1 f°° 

= \ dG exp(— G 2 /2cr 2 )|l + G\~ a 

V27T(7 J -00 



iF\ 



a 1 

2 ! 2 ; 



1 

2a 2 



.(18) 



where V is the Euler gamma function and \F\ is the Rum- 
mer confluent hypergeometric function. In the limit as 
(7 — y 00 the exponent D 2 = a approaches unity as 
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so that the clustering tendency is always present in (|14l) , 
(1151) . no matter how strong the random impulses g n (x). 
The value of a which solves equation (TT51) is plotted as 
a function of a 2 in figure [2l where it is compared with 
the asymptotic approximations, (|13[) and (|19[) and with 
values of the exponent obtained by simulation. 

5. Extension to deterministic maps. One dimensional 
deterministic maps can be chaotic, with a positive Lya- 
punov exponent. It is natural to ask whether these can 
also exhibit clustering behaviour. The best studied ex- 
ample Q is the logistic map, x n+ i — Kx n (l — x n ) = 
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FIG. 2: The correlation dimension of the random map (114[l . 
(|15[1 . determined by solving (|18[) (solid line, red in colour) is 
compared with exponents determined by simulation (o). The 
asymptotic approximations to D2, (|13|l (solid black line) and 
(|19[l (dotted line) are also shown. 

f(x n ) which has been studied exhaustively and which is 
considered to have generic properties. There are intervals 
of the parameter K where the trajectory is attracted to 
stable periodic orbits, interspersed with sets where the 
Lyapunov exponent is positive. When the correlation di- 
mension is small it is well approximated by D2 = A/2?. 
We therefore expect that clustering of trajectories will oc- 
cur close to the boundaries of the chaotic regions, where 
A is small. 

A numerical investigation of the correlation dimension 
for the logistic map was carried out, for a large set of 
values of the coupling parameter K. This set included 
many values close to the edge of a stable region, where the 
Lyapunov exponent, although positive, was very small. 
This investigation produced a surprising result. With one 
exception, no values of K were identified for which the 
numerically determined correlation dimension was clearly 
different from unity (in the chaotic zones) or zero (in the 
stable zones). The only exception was when K was set 
equal to the value which corresponds to the limit point of 
the Feigenbaum period-doubling sequence. At that value 
of K, the results suggested a value of D2 which is less 
than unity but greater than zero, consistent with results 
by Grassberger Q. 



The observation that D2 does not become small when 
A is small is consistent with (TT5)) if the diffusion con- 
stant T> approaches zero at the same time as A approaches 
zero. In the case of deterministic systems, this is in fact 
what happens, as the following heuristic argument shows. 
Consider what happens as the parameter K of the logis- 
tic map is varied from K-, where A is slightly negative, 
to the nearby value K + where A is slightly positive. At 
A'_ the map has an attractor which is a stable periodic 
orbit of period M (say) . The Lyapunov exponent for the 
stable orbit is 

1 M 

a^EH/'H)! (20) 

i=i 

where x* are the points on the periodic orbit. In the 
case of the periodic orbit the shift of Y with every orbit 
is precisely MA, implying that T> — for the stable orbit. 
At K + the periodic orbit has either become unstable, or 
else has ceased to exist. The trajectory then explores 
a dense subset of the line, but it must spend most of 
the time in the vicinity of the sequence of M points vis- 
ited by the nearby stable orbit. While the trajectory is 
trapped close to the periodic orbit, there is negligible ran- 
domness in the values of Z. We therefore expect that T> 
approaches zero at the boundary of the unstable region. 
If a small amount of noise is added to a deterministic 
map, the value of T> remains finite at the boundary of 
the chaotic region, and we find that D2 approaches zero 
smoothly at the boundary. 

Conclusions. Fractal clustering may occur even if 
there is no negative Lyapunov exponent. This was anal- 
ysed and demonstrated in a random dynamical system, 
namely the correlated random walk. In the case of the 
logistic map, the clustering effect was not observed. We 
argued that it is harder to see the clustering effect in a 
deterministic dynamical system, although there does not 
appear to be any reason why it is forbidden. It would be 
interesting to find an example. 
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